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DETAILED ACTION 
Continued Examination Under 37 CFR 1.114 

1 . A request for continued examination under 37 CFR 1.114, including the fee set 
forth in 37 CFR 1.17(e), was filed in this application after final rejection. Since this 
application is eligible for continued examination under 37 CFR 1.114, and the fee set 
forth in 37 CFR 1.17(e) has been timely paid, the finality of the previous Office action 
has been withdrawn pursuant to 37 CFR 1.114. Applicant's submission filed on March 
7, 2006 has been entered. 

Applicant's arguments with respect to claim 1 have been considered but are moot 
in view of the new ground(s) of rejection. 

Claim Rejections - 35 USC § 103 

The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

2. Claims 1-6 rejected under 35 U.S.C. 103(a) as being unpatentable over Nafeh 
(US 5,343,251 ) in view of Walker et al (US 6,928,233) in further view of Foote et al (US 
6,751,354). 

[claim 1] 

In regard to Claim 1 , Nafeh discloses a method for selecting dominant multi-media cues from a 
number of video segments, comprising the steps of: 
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• calculating a multi-media information probability for each frame of the video 
segments ; 

• dividing each of the video segments into sub-segments (Column 2 Lines 55-63 
and Column 3 Lines 20-57 describes the dividing the video segments into sub 
segments); 

• calculating a probability distribution of multi-media information for each of the 
sub-segments using the multi-media information for each frame (Column 6 Lines 
6-12 describes calculating the probability information for each sub-segment); 

• combining the probability distribution for each sub-segments to form a combined 
probability distribution (Column 6 Lines 14-50 describes combining the probability 
distribution for each sub segment to form the entire segments probability); and 

• selecting the multi-media information having the highest combined probability in 
the combined probability distribution as the dominant multi-media cues (Column 
5 Lines 52-67 describes selecting of the multi-media information which has 
desired weight or probability distribution); however, fails to disclose that the 
dividing each of the video segments into sub-segments using pre-selected multi- 
media characteristic and combining the probability distribution for each sub 
segment by averaging the probability distribution for each sub-segment for a 
combined probability distribution. 

Walker et al discloses a signal processing apparatus wherein the video processor determines 
scene changes through extraction of visual/audio segments. Furthermore, it is noted in Column 
3 Lines 63+ through Column 4 Lines 1-10 describes the dividing of the segments using multi- 
media characteristic such as speech, music, noise, and silence. The detection of the video 
segments through these characteristics provides the proper identification of segments through a 
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reliable format completed by the apparatus. Foote et al discloses a method for classifying video 
frames using statistical models by averaging the probability distribution for each sub-segment 
for a combined probability distribution as further described in Column 36 Lines 30+. The use of 
ability of averaging the probability for each sub-segment allows for a more accurate 
classification of the signal. Therefore, it would have been obvious to one of ordinary skill in the 
art at the time of the invention to use the selection of multi-media cues, as disclosed by Nafeh, 
and incorporate a system wherein the segments are divided into sub-segments using pre- 
selected multi-media characteristic, as disclosed by Walker et al, and further incorporate a 
method for determining the probability distribution for each sub-segment, as disclosed by Foote 
et al. 
[claim 2] 

In regard to Claim 2, Nafeh discloses a method, wherein the video segments are selected from 
a group consisting of commercial segments and program segments (Column 2 Lines 1-7 
describes the video segments comprise program and commercial segments), 
[claim 3] 

In regard to Claim 3, Nafeh discloses a method, wherein the dividing video segments into sub- 
segments is performed using close caption information included in the video segments (Column 
3 Lines 44-45 describes the use of closed captioning for classifying and dividing the video 
segments into sub-segments), 
[claim 4] 

In regard to Claim 4, Nafeh discloses a method, wherein the combining the probability 
distribution for each sub-segments is performed by the operation selected from a group 
consisting of an average or a weighted average (Column 5 Lines 64-67 through Column 6 Lines 
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1-24 describes that the selected group of sub-segments consist of weighted average of the 
segments for classification), 
[claim 5] 

In regard to Claim 5, Nafeh discloses a method wherein the combined probability distribution is 
formed from probability distributions of sub-segments of multiple programs (Column 2 Lines 55- 
62 describes that calculations for probability are performed on the sub-segments of multiple 
programs), 
[claim 6] 

In regard to Claim 6, Nafeh discloses a method, which further includes initially selecting multi- 
media cues characteristic of a given TV program type or commercial (Column 2 Lines 63-67 
describes the selection of multi-media cues that are classified as a TV program or commercial). 
3. Claims 7-20 are rejected under 35 U.S.C. 103(a) as being unpatentable over Nafeh (US 
5,343,251) in view of Walker et al (US 6,928,233) in further view of Foote et al (US 6,751,354) 
in further view of Maeda (US 6,580,679). 
[claims 7,12, &15] 

In regard to Claims 7, 12, and 15, Nafeh in view of Walker et al in further view of Foote, 
discloses an apparatus method of segmenting and indexing video, comprising the steps of: 

• pre-processing the video (Column 2 Lines 55-62 describes processing the video 
for classification/indexing); 

• selecting program segments from the video (Column 3 Lines 20-32 describes 
the selecting of program segments from the video); 

• dividing the program segments into program sub-segments (Column 2 Lines 55- 
63 and Column 3 Lines 20-57 describes the dividing the video segments into 
sub segments); 



Application/Control Number: 09/843,499 Page 6 

Art Unit: 2621 

• storing the indexed program sub-segments (Figure 1a shows the storing of 
indexed program sub-segments in the memory buffer); however, fails to disclose 
performing genre-based indexing on the program using multi-media cues 
characteristic of a given genre of program and the dividing each of the video 
segments into sub-segments using pre-selected multi-media characteristic and 
calculating, combining, and selecting the probability distribution for each sub 
segment by averaging the probability distribution for each sub-segment for a 
combined probability distribution. 
Maeda discloses a method of managing file regions on a recording medium. It is noted in 
Column 5 Lines 15-60 that the program segment is indexed according to genre of the program 
to allow for the user to access the segments through desired genre that one would like to 
search. Foote et al discloses a method for classifying video frames using statistical models by 
averaging the probability distribution for each sub-segment for a combined probability 
distribution as further described in Column 36 Lines 30+. The use of ability of averaging the 
probability for each sub-segment allows for a more accurate classification of the signal. 
Therefore, it would have been obvious to one of ordinary skill in the art at the time of the 
invention to use the classifying method, as disclosed by Nafeh in view of Walker, and 
incorporate a the method of indexing the segments according to genre, as disclosed by Maeda. 
[claim 8] 

In regard to Claim 8, Nafeh discloses a method of selecting program segments is performed 
using multi-media cues characteristic of a given type of video segment (Column 2 Lines 1-7 
describes the video segments comprise program and commercial segments), 
[claim 9] 
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In regard to Claim 9, Nafeh discloses wherein the dividing the program segments into program 
sub-segments is performed according to closed caption information included in the program 
segments (Column 3 Lines 44-45 describes the use of closed captioning for classifying and 
dividing the video segments into sub-segments), 
[claims 10, 13, & 16] 

In regard to Claims 10, 13, and 16, Nafeh in view of Walker et al, discloses a method of 
classifying program segments however; fails to disclose the following: 

• comparing the multi-media cues characteristic of a given genre of program to 
each of the program sub-segments; and 

• inserting a tag into one of the program sub-segments if there is a match between 
one of the multi-media cues and sub-segments. 

Maeda discloses a method of classifying program segments wherein the segments are 
compared by the genre of each sub-segment as disclosed in Column 7 Lines 7-37. 
Furthermore, a tag is inserted into the program segments, which discloses the genre of the 
segment as seen in Figures 4a-4b. Thereby allowing the segments to be compared and 
marked when genres are matching which allows user easier access to the programs that fall 
under specific genre that they maybe searching. Therefore, it would have been obvious to one 
of ordinary skill in the art at the time of the invention to use a system for classifying program 
segments, as disclosed by Nafeh in view of Walker et al, and incorporate a method of 
classifying the program segments by genre and marking the genres for comparison, as 
disclosed by Maeda. 
[claims 11,14,&17] 
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In regard to Claims 11, 14, and 17 Nafeh discloses a method as recited in Claim 7, which further 
includes performing object-based indexing on the program sub-segments (Column 5 Lines 30- 
67 describes the object-based indexing of the program sub-segments), 
[claims 18, 19, 20] 

In regard to Claim 18, 19, 20, Nafeh discloses a method wherein the average is selected from 
the group consisting of: a straight average and a weighted average (Column 4 Lines 63+ 
through Column 5 Lines 1-10 describes the method wherein the average is selected from a 
group of straight and weighted averages). 

Conclusion 

The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. 

• Massen (US 5,794,788). 

Contact Information 

Any inquiry concerning this communication or earlier communications from the examiner 
should be directed to Jamie Vent whose telephone number is 571-272-7384. The examiner can 
normally be reached on 7:30am-5:00pm. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Thai Tran can be reached on 571-272-7382. The fax phone number for the 
organization where this application or proceeding is assigned is 703-872-9306. 
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Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private 
PAIR system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 
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05/08/06 



